Reducing Complexity on Coding Unit Partitioning in Video Coding: A Review

In this article, we present a survey on the low complexity video coding on a coding unit (CU) partitioning with the aim for researchers to understand the foundation of video coding and fast CU partition algorithms. Firstly, we introduce video coding technologies by explaining the trending standards and reference models. They are High Efficiency Video Coding (HEVC), Joint Exploration Test Model (JEM), and VVC, which introduce novel quadtree (QT), quadtree plus binary tree (QTBT), quadtree plus multi-type tree (QTMT) block partitioning with expensive computation complexity, respectively. Secondly, we present a comprehensive explanation of the time-consuming CU partitioning, especially for researchers who are not familiar with CU partitioning. The newer the video coding standard, the more flexible partition structures and the higher the computational complexity. Then, we provide a deep and comprehensive survey of recent and state-of-the-art researches. Finally, we include a discussion section about the advantages and disadvantage of heuristic based and learning based approaches for the readers to explore quickly the performance of the existing algorithms and their limitations. To our knowledge, it is the first comprehensive survey to provide sufficient information about fast CU partitioning on HEVC, JEM, and VVC

Unsupervised Anomaly Detection and Localization Based on Deep Spatiotemporal Translation Network

n/

Joint FMO and Adaptive Intra Refresh for Error Resilience in H.264 Video Coding

In this paper, we propose an explicit Flexible Macroblock Ordering (FMO) map using distortion from error propagation. The effects caused by the damaged MBs of the current frame to the next frame and the other MBs in the same slice group are estimated. These effects can be used in the evaluation of the MBs' importance in the current frame, and a suitable map with a reduced effect of error propagation can be generated. In addition, to counteract with error propagation, intra refresh is a known method used to reduce the dependency between frames therefore could stop error propagation. Taking into account the channel state information, this paper also proposes an intra refresh algorithm that chooses the number of intra MBs for each frame. MBs having much effectiveness to the current frame and the next frame will be chosen for intra coding mode. By coupling this method with proposed FMO, it would help reduce the loss of important and intra coded MB. Results show that the proposed method has some improvements in terms of PSNR and the number of undecodable macroblocks as compared to some other methods.APSIPA ASC 2009: Asia-Pacific Signal and Information Processing Association, 2009 Annual Summit and Conference. 4-7 October 2009. Sapporo, Japan. Poster session: Image, Video, and Multimedia Signal Processing 2 (6 October 2009)

Video Processing and Communications Researches

講演者所属: Chulalongkorn University講演日: 平成27年10月7日講演場所: 情報科学研究科大講義室L1In this talk, my researches on video processing andcommunications conducted at video technology research group, Chulalongkorn University. There are several areas of researches. Firstly, wireless video coding and transmission researches arediscussed. The aim is to deliver very good quality video underchannel error constraint. Secondly, we have conducted many years ofresearches on video analytics for surveillance applications. Thirdly, current project that integrates the knowledge of video analytic, videocoding, and wireless communications is on-going. We are developed theprototype of video based security monitoring using high speed wirelesscommunication system. The fourth area is the accessible applicationswhich is Electronics Thai Sign Language Communication System. The last area is social media analysis on East Japan Earthquake which isthe collaboration with Gakushuin University, Japan

New Error Resilience Technique Using Adaptive FMO and Intra Refresh for H.264 Video Transmission

In this paper, we propose an error resilience scheme for wireless video coding based on adaptive flexible macroblock ordering (FMO) and intra refresh. An FMO explicit map is generated frame-by-frame by using prior information. This information involves estimated locations of guard and burst sections in the channel and estimated effect of error propagation (EEP) from the previous frame to the current frame. In addition, the role of the current frame in propagating an error to the next frame is also considered. A suitable intra refresh rate which is adaptive to the channel state is used to reduce the dependence between frames and thus can stop the EEP. The results in experiments show that the proposed method gains some improvements in terms of peak signal-to-noise rate (PSNR) as compared with some other methods that have not considered the channel condition and the error propagation in generating an FMO map

Learning-Based Rate Control for High Efficiency Video Coding

High efficiency video coding (HEVC) has dramatically enhanced coding efficiency compared to the previous video coding standard, H.264/AVC. However, the existing rate control updates its parameters according to a fixed initialization, which can cause errors in the prediction of bit allocation to each coding tree unit (CTU) in frames. This paper proposes a learning-based mapping method between rate control parameters and video contents to achieve an accurate target bit rate and good video quality. The proposed framework contains two main structural codings, including spatial and temporal coding. We initiate an effective learning-based particle swarm optimization for spatial and temporal coding to determine the optimal parameters at the CTU level. For temporal coding at the picture level, we introduce semantic residual information into the parameter updating process to regulate the bit correctly on the actual picture. Experimental results indicate that the proposed algorithm is effective for HEVC and outperforms the state-of-the-art rate control in the HEVC reference software (HM-16.10) by 0.19 dB on average and up to 0.41 dB for low-delay P coding structure

Hierarchical-P reference picture selection based error resilient video coding framework for high efficiency video coding transmission applications

In this paper, a new reference picture selection (RPS) is proposed for a high efficiency video coding (HEVC) framework. In recent studies, HEVC has been shown to be sensitive to packet error which is unavoidable in transmission applications especially for wireless networks. RPS is an effective error resilient technique for video transmission systems where a feedback channel with short round trip delay time is available. However, its procedure cannot directly apply to the HEVC framework and thus this paper expands it. In RPS, error propagation can still happen during round trip delay time. To alleviate the effect of error propagation for better quality, the proposed algorithm considers both the RPS technique and the region-based intra mode selection method by using some novel features of HEVC. Experimental results demonstrate that the proposed method outperforms the hierarchical-P RPS algorithm in terms of PSNR and other metrics. The average PSNR improvement of the proposed algorithm over the reference algorithm under 10% packet error rate is 1.56 dB for 1080p sequences, 2.32 dB for 720p sequences and 1.01 dB for wide video graphics array (WVGA) sequences, respectively. The performance of proposed method is also tested for applications where feedback information is not available. The proposed method shows noticeable improvement for video sequences that contain low or moderate level of motions